Papers with history question answering
Empirical Analysis of Task Mixture Effects in Small-scale Instruction Tuning: A Statistical Approach (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that instruction tuning can significantly vary depending on the task and format diversity of training data. |
| Approach: | They conduct experiments on unlabeled instruction corpora to identify effective mixtures. |
| Outcome: | The proposed model can achieve up to 5.7 speedup in training with 1,000 curated examples. |